As I commented on a previous post, I work at an intelligence logistic company called www.simpliroute.com The data analysis phase and previous features to be ingested in bigquery were analyzed by smaller segments (a sample of the large quantity of GPS that exist, in ideal situations such as no rain, protests, numerous variations and in just one sector). Travel time estimation and prediction using GPS data developed by: Javiera Morales Benza, Cristian Cortés, Victor Gonzalez, and Alvaro Echeverria. To work with 3TB of RAM in distributed systems with a controlled budget is a task that requires expertise and care (calculated from dataproc with mllib), specially when your models have only processed samples, and the dataset don't know the time series generated by the intake of GPS. Decisions were made for the next phase, all achieved by analytics generation, data cleaning pipelines and a lot of bigquery analysis (trial and error takes on a key role in the cost here).